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Mail Stop Appeal Brief - Patents 
20 Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 



25 Sir: 



Appellants her'eby reply to the Examiner's Answei, mailed November 1, 
2006 (referred to heieinaftei as "the Examinei's Answer"), in an Appeal of the final 
r e:]'ection of claims 1-12 in the above-identifred patent application 

REAL PARTY IN INTEREST 
A statement identifying the real party in interest is contained in Appellants' 

Appeal Brief . 



35 RELATED APPEALS AND INTERFERENCES 

A statement identifying related appeals is contained in Appellants' Appeal 

Brief 
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STATUS OF CLAIMS 
Appellants withdiaw the appeal of claims 5 and 9,. Claims 1, 7, and 12 are 
being appealed,, 

5 STATUS OF AMENDMENTS 

A statement identifying the status of the amendments is contained in 
Appellants' Appeal Brief 

SUMMARY OF CLAIMED SUBJECT MATTER 
1 0 A Summaiy of the Invention is contained in Appellants' Appeal Biief ' 

STATEMENT OF GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL 

A statement identifying the giounds of T ejection to be reviewed on appeal is 
contained in Appellants' Appeal Biief 

15 

CLAIMS APPEALED 
A copy of the appealed claims is contained in an Appendix of Appellants' 
Appeal Brief and in an Appendix of this Reply Biief 

20 ARGUMENT 

In the Response to Arguments section of the Examiner's Answer, the 
Examiner asserts that Knpiec teaches an "explicit answei to a question" (col . 32, Table 8: 
Mailei, Noiman; col. 31, Table 7; col. 37, lines 38-53), 

Regarding the Examiner's comment on Table 8, Appellants note that the 
25 phiase "Mallei, Noiman" actually refets to the title of the document, and that any explicit 
answei to the question appears to be coincidental In Table 8, Kupiec teaches "Document 
Title: Mailer, Noiman, " If "Mailer, Noiman" was the answer discoveied in the text, a 
person of oidinaiy skill in the art would expect the answer to be "Noiman Mailer," which is 



2 



Docket No,.: YOR920000807US1 



how the cited name appear s in the relevant text of Table 8. 

Also, legaiding Table 8, Kupiec teaches that 

the piesentation heie is different fiom that of piioi ait IR 
systems. Answer hypotheses aie shown to the user to focus his oi hei 
5 attention on likely answers and how they lelate to othei phiases in the 

question., The text presented is not necessarily from documents that have 
high similaiity scores, but rather fiom documents that confiim phrase 
relations that lend evidence for an answer , This behavior is readily 
understood by users, even though they have not been involved in the tedious 
1 0 intermediate work done by the system. 

In Table 8, the first two sentences are from primary 
documents The last sentence confirming Norman Mailer as a novelist is a 
fiom a secondary document, The sentence was confirmed by a 
lexico-syntactic pattern which identifies the answer hypothesis as being in a 
1 5 list-inclusion relationship with the type phiase 

(Col 32, line 64, to col. 33, line 1 1 ) 

In the Appeal Brief, Appellants noted that, regarding Table 7, Kupiec 

teaches that "the relevant articles are heuristically scored according to the degree and 

number of matches with the phrases of the input question After scoring, the relevant 

20 articles are ranked according to their scores."' (Col. 31, lines 34-41; emphasis added.) 
After the hypothetical answers are extracted, Kupiec teaches that "answer hypotheses are 
s cor ed on a per-article basis according to the sum of the scores of the articles in which 
they occur'' (Col. 31, lines 52-62; emphasis added.) Kupiec teaches that answer 
hypothese are based on the article scores; Kupiec does not disclose or suggest that answer 

25 scores are based on scoring features of possible answers Examples oi scoring features of 
possible answers are disclosed on page 6, line 14, to page 7, line 28, of the originally filed 
specification 

More importantly, Kupiec teaches that, 'for the question given in Table 7 

MURAX produces the output shown in Table 8 '' (Col. 32, lines 38-39; emphasis added.) 

3 0 Thus, a per son of oi dinaiy skill in the art would read these steps as also applying to Table 8 

Also, in the text cited by the Examiner, Kupiec teaches that 

it is illustrated in the following question and primary 
document match sentences: 
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"What film pits Humphiey Bogait against gangsters in the 

Florida Keys?" 

" . . Bacall and Bogait became a famous romantic couple in 
films such as The Big Sleep (1946) and Key Laige (1948) " 

5 

"Some of his most populai films weie The Maltese Falcon 
(1941); Casablanca (1942), with Ingrid Bergman; The Big Sleep (1946) 
costariing his wife, Lauien Bacall; The Tieasuie of Siena Madie 
(1948); " 

10 Secondary co-occunence queries determine that the answer 

hypothesis Key Largo co-occms with Floiida Keys^ but the other "film" 
hypotheses do not; thus in the absence of stiongei evidence to the contiaiy, 
Key Lai go receives a preference, 
(Col. 37, lines 38-53.) 

15 This teaching, however, does not contradict Kupiec's earliet teachings 

(cited above), including the teaching that answer scores are based on the article scor es.. 

In the Examiner 's Answer , the Examiner asserts that "each answer is scored 
on a per article basis, which is the scoie of the answer hypothesis, which is not a document, 
each answer hypothesis being scored based on an article- (the article is scored based on the 

20 degree and number of matches with the phrase of the input question which includes 
features of the answer), according to the sum of the scores of the articles in which they 
occur More specifically, the article has a score, and the answer hypothesis also has a 
scor'e, based on scoring features of possible answers " 

As the Examiner' acknowledges, Kupiec teaches that "answer' hypotheses 

25 are scar ed on a per-article basis according to the sum of the scores of the articles in which 
they occur ?' Independent claim 1 requires extracting scoring features from a candidate list 
of passages of possible answers; scoring the possible answers using the extracted features 
and a feature scoring function; and presenting the best scoring possible answer' to the user 
with context from the passage containing the answer , Independent claim 7 requires a 

30 feature combination module, containing a feature extraction*^ and ^'compute composite 
score'' components; an answer selection module and an answer' presentation module, and 
independent claim 12 r equires scoring ^^each possible answer phrase^ selecting one or 
more of the best scoring answer phrases^ and displaying the answer phrases to the user. " 
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Kupiec deteimines scores based on an entire article, where "the degree and number of 
matches with the phiases of the input question'' (col. 31, lines 34-36); Kupiec does not 
disclose oi suggest that answers are scoied using ^^extracted features and a feature 
scoring function. 

5 Regarding the Examiner's assertion that "one cannot show nonobviousness 

by attacking references individually where the rejections are based on combinations of 
r eferences," Appellants note that the argument r egar ding Braden-Haider was not presented 
to attack the references individually, but was presented to demonstrate that none oj the 
cited references disclose or suggest certain limitations that distinguish the present claims 

1 0 fiom the cited prior art . 

ThuSj Kupiec and Braden-Harder et al, alone or in combination, do not 
disclose or suggest extracting scoring features from a candidate list of passages of possible 
answers; scoring the possible answers using the extracted features and a featme scoring 
function; and presenting the best scoring possible answer to the user with context from the 

1 5 passage containing the answer , as required by claim 1 , do not disclose or suggest a feature 
combination module, containing a "feature extraction" and "compute composite score" 
components; an answer selection module and an answer presentation module, as required 
by independent claim 7, and do not disclose or suggest scoring each possible answer' 
phrase, selecting one or' more of the best scoring answer phrases, and displaying the answer' 

20 phrases to the user, as required by independent claim 12 . 

Conclusion 

The rejections of the cited claims under sections 102 and 103 in view of 
Kupiec and Braden-Harder et al., alone or in combination, are therefore believed to be 
25 improper and should be withdrawn,, The remaining r ejected dependent claims ^e believed 
allowable for at least the reasons identified above with respect to the independent claims . 
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The attention of the Examiner and the Appeal Boaid to this matter is 

appieciated,, 

Respectfiilly, 
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Date: Januaiy 3, 2007 Kevin M Mason 

Attorney foi Applicant(s) 
Reg. No. 36,597 

1 0 Ryan, Mason & Lewis, LLP 

1300 Post Road, Suite 205 
Fairfield, CT 06824 
(203) 255-6560 
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APPENDIX 

1 , A method foi selecting answers to natuial language questions from a 
collection of textual documents comprising the steps of; 

5 extracting scoiing features fiom a candidate list of passages of^ possible 

answers; 

scoiing the possible answers using the extiacted featuies and a featuie 
scoiing function; and 

presenting the best scoring possible answei to the usei with context fiom 
10 the passage containing the answei 

2. A method as in claim 1, wherein the featmes used to score possible 
answers consists of one oi moie of the following featmes: a semantic type of a cmient 
suspected answer, a position of the suspected answei among all suspected answer s within 

15 all document passages, a position of the suspected answer among all suspected answers 
within the given passage, a number of suspected answers of a given semantic type retrieved 
within a given passage, a number of words in a suspected answer that do not appear in the 
user question, a position of the semantic type in the list of potential semantic types foi' the 
question, an aver age distance in wor ds between the beginning of the potential answei and 

20 the words in the question that also appear in the passage, a passage relevance as computed 
by the information retrieval engine, a frequency of a given potential answer on the list, a 
semantic relation between words from the question and words from the potential answer, 
and a strength score that is a function of the r elevance score . 

25 3 . A method as in claim 2, wheiein the featuie scoiing function is a linear 

combination of weighted features 

4 . A method as in claim 3, wherein the parameters of the scoiing function 
are manually deteimined,. 
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5 A method as in claim 3, wherein the parameters of the scoring function 
aie learned by a machine learning algoiithm., 

6 , A method as in claim 1 wheie the candidate Ust of passages of possible 
5 answeis is obtained fiom the collection of documents using an infoimation letiieval engine 

7. A computer system that extracts answers to natural language questions 
fiom a laige collection of textual documents consisting of one or more of the following 
modules: 

10 a feature extraction module; 

a feature combination module, containing a "feature extraction" and 
''compute composite score" components; 

an answer selection module; and 
an answer presentation module. 

15 

8 , A computer system, as in claim 7, wherein the feature extraction 
module extracts one or more of the following features: a semantic type of the current 
suspected answer ^ a position of the suspected answer among all suspected answers within 
all document passages, a positron of the suspected answer among all suspected answers 

20 within the given passage, a number of suspected answei s of a given semantic type retrieved 
within a given passage, a number of words in an suspected answer that do not appear' in the 
user question, a position of the semantic type in the list of potential semantic types for the 
question, an average distmce in words between the beginning of the potential answei and 
the words in the question that also appear' in the passage, a passage relevance as computed 

25 the retrieval engine, a fiequency of a given potential answer on the list, a semantic relation 
between words fiom the question and words from the potential answer, and a strength score 
that is a function of the r elevance score.. 
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9. A computei system as in claim 7, wherein the feature combination 
module employs a featme scoiing function with parameters leamed by a machine learning 
method 

5 10 , A computei system as in claim 7, wherein the answei selection module 

selects the answei with the best score obtained from the featuie combination module. 

1 1 . A computer system as in claim 1, wherein the answei presentation 
module shows the top scored answer within the context as specified by a usei or a system., 

10 

12 A computer piogtam product that peifoims the steps of ; 
determining a featme scoiing function duiing a tiaining phase eithei 
manually or via a machine learning algorithm applied to a set of tiaining questions, 
corresponding answer passages, and certain extracted features; and 
15 during an execution phase, extracting certain features from questions and 

corresponding possible answei phrases, applying the featuie scoring function determined 
during the training phase to score each possible answers phiase, selecting one or more of 
the best scoring answer phiases, and displaying the answei phrases to the usei with 
optional additional context from the answei passages. 

20 
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EVIDENCE APPENDIX 
There is no evidence submitted pursuant to § 1 ,130, 1 .131, or 1.1 32 oi 
entered by the Examinei and r elied upon by appellant.. 
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RELATED PROCF.EDTNGS APPENDIX 
There aie no known decisions tendered by a court oi the Boaid in any 
proceeding identified pursuant to paragraph (c)(l)(ii) of 37 CFR 41 .37 
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